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SUMMARY 


C»JECTIVE 

U  /VI  ^r> 

— To  ahci^that  the  computational  complexity  of  the  Viterbi  decoding  algo¬ 
rithm  can  be  reduced  for  Maximum  Likelihood  Sequence  Estimation  on  time- 
variant/  fading  channels  when  the  channel  constraint  length  is  reduced. 


y - -V  RESULTS-- 

An  algorithm  is  developed  that  reduces  the  computational  complexity  of 
the  Viterbi  decoding  algorithm.  For  time-variant/  fading  channels,  the  effec¬ 
tive  constraint  length  may  expand  or  contract,  emd  it  is  shown  that  we  can 
expand  or  contract  the  state  trellis  diagram  of  the  Viterbi  algorithm  accord¬ 
ingly.  The  derived  algorithm  requires  knowledge  of  the  channel's  intersymbol 
interference  patterns.  These  results  apply  not  only  to  the  hf  channel,  but  to 
any  channel  characterized  by  convolutional  encoding.  In  addition,  channels 
that  demonstrate  catastrophic  behavior  are  found  and  discussed. 
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I .  IMTRODUCTZOM 


CooBunlcation  signal  transalssions  in  the  high  frequency  (hf)  band  (2-32 
MHz)  propagate  thousands  of  miles  by  reflecting  off  the  ionosphere.  This 
feature  has  long  been  exploited  to  provide  lon^range  comnunications,  such  as 
ship  to  ship  and  ship  to  shore.  Homver,  many  propagation  paths  (reflections) 
are  possible,  and  messages  are  frequently  garbled  due  to  the  delayed  echoes 
that  arrive  at  the  receiver.  Ihis  problem  causes  severe  degradation  to  dig¬ 
ital  communication  links.  The  delayed  echoes  cause  Intersymbol  Interference, 
whi^h  results  in  very  high  symbol  error  rates. 

One  way  to  approach  this  problem  is  to  treat  the  channel  as  a  waveform 
encoder  ( ref  1 ) .  The  receiver  can  then  recover  the  transmitted  data  by  de¬ 
coding  the  received  waveform.  This  technique  is  called  Maximum  Likelihood 
Sequence  Estimation  (MLSE)  (ref  1-6)  and  uses  the  Vlterbl  algorithm  (ref  7)  to 
decode  the  received  waveform,  in  the  general  problem  of  intersymbol  interfer¬ 
ence  on  fading,  time-variant  channels,  we  will  examine  what  effect  fading  will 
have  on  the  complexity  of  the  Vlterbl  algorithm. 


1.  G.  David  Forney,  "Maximum  Likelihood  Sequence  Estimation  of  Digital  Se¬ 
quence  in  the  Presence  of  Intersyndsol  Interferences,"  IEEE  Transactions  on 
Information  Theory,  Vol  11-18,  No.  3,  May  1972,  pages  363-378. 

2.  L.  E.  Hoff  and  A.  R.  King,  "Skywave  Comnunicatlon  Techniques,"  NOSC  TR  709 
30  Mar  1981. 

3.  L.  B.  Hoff,  R.  L.  Nerk  and  s.  Morvell,  "Maximum  Likelihood  Sequence  Esti¬ 
mation  for  Unknown,  Dispersive,  and  Time  Variant  Communication  Channels," 
NOSC  TR  727,  30  Sept  1981. 

4.  6.  Ungerboeck,  "Linear  Receiver  and  Maximun-Llkellhood  Sequence  Receiver 
for  Synchronous  Data  Signals,"  IEEE  International  Communications  Confer¬ 
ence  Proceedings.  June  1973. 

5.  6.  ungerboeck,  "Adaptive  Maximum-Likelihood  Receiver  for  Carrier-Modulated 
Data  Transmission  System,"  IBEB  Transactions  on  Communications.  Vol-Com- 
22,  No. 5,  May  1974. 

6.  A.  J.  Viterbi,  "Convolutional  Codes  and  Their  Performance  in  Communication 
Systems,"  IEEE  Transactions  on  Communications  Technology,  Vol-Cam-19,  Ho. 
5,  Oct  1971. 

7.  A.  J.  Viterbi,  and  J.  K.  Omura,  Principles  of  Digital  Communication  and 
Coding,  McGraw-Hill,  New  York,  1979. 


As  %ie  model  the  multipath  channel  as  a  convolutional  encoder,  we  first 
consider,  in  Sections  II  and  III,  a  standard  convolutional  code  sent  over  an 
additive  vihite  Gaussian  noise  (AHGN)  channel  using  Viterbi  (maximum  likeli¬ 
hood)  decoding.  If  the  taps  of  the  generator  polynomials  suddenly  change  at 
time  t^  so  that  the  constraint  length  does  not  increase,  it  should  not  affect 
the  way  in  tihich  the  Viterbi  algorithm  has  decoded  prior  to  that  time  and 
should  also  not  affect  the  metrics.  Therefore,  if  the  new  code  is  known,  the 
only  change  necessary  in  the  Viterbi  algorithm  would  be  to  update  the  code 
words  generated  by  the  channel  in  the  trellis  diagram.  The  concept  of  fading 
in  and  out  affects  the  taps  of  the  generator  polynomials,  and  hence  the  con¬ 
straint  length  may  contract  or  expand.  Since  the  Viterbi  algorithm's  com¬ 
plexity  is  exponential  in  the  constraint  length,  we  will  show  that  idiile  the 
channel  is  operating  at  the  smaller  constraint  length,  we  can  take  advantage 
of  this  in  the  Viterbi  algorithm  without  any  loss  of  information  concerning 
the  metrics  or  survivors  tdien  the  constraint  length  expands  back.  We  will 
focus  attention  upon  the  case  in  which  the  taps  fading  to  zero  correspond  to 
the  higher  degrees  of  the  generator  polynomials.  Because  the  larger  degrees 
correspond  to  the  echoes,  it  is  more  likely  that  an  echo  fades  to  zero,  as 
opposed  to  the  first  strong  received  signal  fading  to  zero.  It  should  be 
noted,  however,  that  in  the  event  the  first  signal  fades  to  zero,  one  can 
always  still  decode  using  the  larger  constraint  length  even  though  the  effec¬ 
tive  constraint  length  has  dropped. 

Let  us  assume  that  at  time  t^  the  constraint  length  decreases  from  K  to 
K* .  We  will  show  that  if  we  identify  as  a  group  all  states  with  the  same 
Initial  K'-l  bits  from  time  t^  (the  initial  K'-l  bits  because  we  are  assuming 
that  the  degree  of  the  generator  polynomials  decreases  from  K-1  to  K'-l),  and 
if  we  define  the  metric  of  the  group  to  be  the  best  metric  of  all  states  in 
the  same  group,  then  maximum  likelihood  decoding  on  the  reduced  trellis  de¬ 
codes  in  the  same  fashion  as  would  the  larger  trellis.  This  all  assines  that 
L  K-K',  where  L  is  the  number  of  input  bits  processed  at  the  smaller  con¬ 
straint  length.  (In  all  practical  applications,  we  will  have  L  »  K-K'.)  In 
the  event  that  L  <  K-K',  we  can  substitute  K-1-L  for  K'-l  above.  The  reduced 
trellis  behaves  exactly  as  the  standard  trellis  diagram  for  a  Viterbi  decoder 
of  constraint  length  K'-l. 
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When  the  channel  expands  to  a  larger  constraint  length,  it  is  necessary 
for  the  Viterbi  decoding  algorithm  to  be  given  a  warning  of  (K-K* )  input  bits 
to  prepare  for  the  larger  constraint  length.  This  presents  little  difficulty 
as  there  is  normally  a  delay  due  to  the  Implementation  of  the  algorithm  that 
is  much  greater  than  the  required  (K-K*)  bit  delay.  However,  if  the  delay  for 
seme  reason  does  not  naturally  occur,  one  can  always  institute  a  mandatory 
delay  of  N  bits,  %diere  M  is  an  upper  bound  for  the  largest  possible  constraint 
length . 

In  section  IV  we  set  up  a  model  for  the  hf  channel  and  show  that  the  re¬ 
sults  for  convolutional  codes  extend  to  the  time-variant  hf  channel. 

When  the  echoes  of  the  multipath  channel  are  equally  spaced  in  time  and 
all  of  equal  strength,  the  code  produced  by  the  channel  is  catastrophic. 

Other  codes  with  taps  of  unequal  strength  are  also  shown  to  be  catastrophic. 

In  section  V  we  examine  this  class  of  codes  potentially  generated  by  the  hf 
channel . 

Although  the  channel  may  give  rise  to  a  catastrophic  code,  given  con¬ 
tinuous  fading  over  a  randomly  changing  channel,  the  percentage  of  time  these 
channels  occur  is  very  small.  The  echoes  must  all  be  exactly  of  equal 
strength  and  the  path  spacing  must  also  be  a  multiple  of  the  baud  rate  for  a 
catastrophic  code  to  arise.  Furthermore,  even  when  we  have  a  catastrophic 

2 

code,  the  error  rate  during  a  catastrophic  burst  could  be  as  low  as  , 
where  K  is  the  constraint  length.  There  is  much  roan  for  further  investiga¬ 
tion  regarding  the  performance  of  these  codes. 

II.  DEFINITIONS  AND  NOTATIONS 

An  attempt  is  made  to  keep  the  terminology  for  convolutional  codes  con¬ 
sistent  with  ref  6.  (For  further  discussion,  see  ref  7  or  8.)  Suppose  %#e 
start  with  a  convolutional  code  of  constraint  length  K.  All  states  will  be  a 

8.  R.  J.  McBlieoe,  "The  Theory  of  Information  and  Coding,"  Encyclopedia  of 
Mathematics  and  Its  Applications,  Vol.  3,  edited  by  G.  C.  Rota,  Addlson- 
Wesley,  1977. 


sequence  of  K-1  input  symbols.  If  I  is  any  input  symbol,  S-^S*  will  denote 

the  state  transition  from  S  to  S'  upon  input  of  I,  and  we  will  call  S'  the 

I-successor  of  S,  or  write  S'  *  I(S>.  (In  other  words,  if  S  =  I^l2...Ij^  ^  , 

then  S'  »  Il^l2>..Ijj_2*^  pred  (S')  be  the  set  of  all  states  that  map  into 

S'  via  some  input  symbol  I.  For  m  <  K-1,  let  [S]  designate  the  set  of  all 

~  in 

states  which  have  the  same  initial  m  symbols  as  S.  In  this  notation,  if 


pred  (S')  =  (1) 

To  clarify  the  above  notation  we  look  at  the  following  example,  where  K  =  4 
and  the  input  alphabet  is  (0,1). 

PRESENT  STATE  NEXT  STATE 


STATE  TRANSITION  DIAGRAM 


A  solid  line  indicates  an  input  of  a  "0"  and  a  dashed  line  indicates  a  "1." 

We  can  see  that  011— 1.-101,  101  is  the  I-successor  of  011,  pred  (101)  - 
(010,011)  =  [01112  =  [01012  and  [0111^  =  (OOO,  001,  010,  Oil). 

Extending  the  definition  of  the  I-successor  of  a  state  to  that  of  a  group 
of  states,  let  I({S^,  ...,S^})  =  (KS^)...,  KS^^)).  Therefore,  if  I  *  1, 
I([011l2)  °  I(COIIJ^)  “  (100,  101)  »  [IOII2. 

In  general  it  is  easy  to  show  that  if  S-^S'  and  m  £  K-1,  %fe  have 

^  <IS1_  ,)  -  [I(S)1  -  [S'l 

iR*i  ID  n 


(2) 


(3) 


pred  ( [S' J_)  ■  [S] 

in  n**  I 

Equation  (1)  Is  just  a  special  case  of  equation  (3). 

Given  a  state  S  and  input  symbol  I,  there  is  a  corresponding  code  word  pro¬ 
duced  by  the  shift  register  2uid  generator  polynomials  (see  ref  8)>  We  will 
denote  that  code  word  by  C(I,S). 

At  each  state  in  the  trellis  diagram  we  store  the  metric  and  the  survivor 
(the  shortest  path).  To  update  the  metrics,  for  a  given  state  T  with  first 
symbol  I,  and  received  vector  we  set 

M(T)  =  max  U(S*)  +  log  prob[R. |C(  I,S' )] 

S'c  pred(T)  ^ 

and  by  choosing  the  state  (and  survivor)  with  the  largest  metric  we  are  em¬ 
ploying  maximum  lilcelihood  decoding. 

Set  S  =  [Sl,^,_,  (4) 

and 

m(S)=  max  w(S' )  (4* ) 

S'ei 


111.  VARIABLE-CONSTRAINT-LENGTH  CONVOLUTIONAL  CODES 

Up  until  time  t^  we  have  a  trellis  diagram  set  up  to  decode  a  constraint 
length  K  convolutional  code,  at  which  time  the  constraint  length  suddenly 
reduces  from  K  to  K* .  We  can  still  decode  the  smaller  code  using  the  larger 
trellis.  If  we  do  so,  we  claim  the  following: 

Proposition  1 ;  If  states  S^  and  S^  agree  on  the  first  m  symbols  and  m  K'-l, 
then  C(I,S^)  »  C(1,S2)  for  all  input  symbols  I. 
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Setting  m  =  K'-l,  we  can  now  speak  of  C(I,S)  without  ambiguity. 

Theorem  1 :  If  S,  is  the  state  with  the  maximum  metric  at  time  t,  and  if  the 
“  L 

shortest  path  to  passes  through  (at  time  then  IJ(S^) 

=  u(i~)  at  time  t. ,  for  0  <  i  <  L.  In  other  words,  the  best  path  through  a 
L  ^ 

constraint  length  K  trellis  is  equivalent  to  the  best  path  through  a  con¬ 
straint  length  K'  trellis. 

Proof:  Clearly  p ( S, )  =  u(S, )  as  S,  has  the  best  metric  of  all  states  at  t^ . 

— — —  Jj  L  L  __ 

Therefore,  if  there  exists  some  state  S.  such  that  ij(S.)  ^  u(S.),  choose 

1  _  11  _ 

i  to  be  the  last  such  occurrence,  ie,  u(S^)  <  u(S^)  and 

Suppose  I  is  the  input  symbol  taking  to  Let  e  S^,  where  ii(S|)  = 

U(i~),  and  let  I(S.')  =  S!  .  Then  S*  e  [by  equation  (2)]  and  C(I,S  )  = 

1  11+1  1+11+1  1 

C(I,SM  (by  Proposition  1).  Therefore,  the  metric  update  factors, 

log  prob  (R^|C),  are  the  same.  But 

y(S^^^)  =  p(S^)  +  log  prob  [R^|C(I,S^)] 

and  ‘'^^i+l^  "  u(S^)  +  log  prob  (R^|C(I,S^M 

and  since  u(S^)  <  li(SM,  we  have  g(S^^^)  <  u(S'^^^),  contradicting  the  assump¬ 
tion  that  =  u(S^^^).  Therefore,  no  such  i  exists  and  we  have  proven 

the  theorem. 

Let  P([T]  )  =  max  u(S).  [If  m  =  K'-l  we  would  have  iJ(T).]  for  notational 
"*  S€[T1 

m 

simplicity  we  will  write 

U(T)  for  U( [T]  ) .  ( 5 ) 

m  m 

Proposition  2 :  If  I(S)  =  T  and  m  K'1,  then 

u(T)  .  =  u(S)  +  log  prob  {R|C( I , [S]  ) } . 
m+1  m  m 
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f:  Set  C  *  C(I,[S]^)  (see  remark  following  Proposition  1).  Since 

( tT]  =  [S]  [from  equation  (3)l,  we  have  from  the  definition  of  u(T); 

m+ 1  m 


u(T)  =  meuc  (u(S*)  +  log  prob  (R|C)). 

S'e [S] 

m 

n  that  m  ^  K'-l,  the  log  prob  (R|C)  term  stays  constant  for  all  S*e[S]^ 
Proposition  1).  Therefore,  w(T) 


m+1 


max  u(S’)j+  log  prob  {R|C) 


=  w  ( s )  +  log  prob  ( R 1 C ) 


illary :  If  I(S)  =  T  and  m  K'-l,  then 

!  U[S']_  + 


u  ( T )  =  max 

^  ts']^c[s]„  , 

in  —  I 


I 


log  prob 


next  theorem  follows  directly  from  the  corollary. 


>rem  2 ;  Let  K’  <  K  and  suppose  the  degrees  of  the  generator  polynomial  for 
>nstraint  length  K  convolutional  code  suddenly  decrease  from  K-1  to  K'-l. 
ig  the  Viterbi  algorithm  to  decode  the  constraint  length  K'  convolutional 
!  on  a  constraint  length  K  trellis,  we  can  simulate  a  constraint  length  K' 
•lis  by  identifying  all  states  with  the  same  initial  K'-l  bits.  This 
iracted  trellis  decodes  in  exactly  the  same  fashion  as  a  standard  trellis 
a  convolutional  code  of  constraint  length  K' . 

In  light  of  Proposition  2,  we  only  need  to  know  the  metrics  of  IS]^  in 
*r  to  find  the  next  metrics  of  This  paves  the  way  for  expanding 

constraint  length  from  K'  back  to  K. 


At  time  t  suppose  that  we  must  have  a  trellis  diagram  to  accommodate  a 
itraint  length  K  code.  We  assume  that  we  have  been  sending  a  constraint 
[th  K'  code  from  time  t^.  Then  at  time  t-1  (assuming  that  each  information 
requires  one  time  unit  to  process] ,  we  must  know  the  best  metrics  of  each 
■.he  groups  of  states  Taking  the  K-2  bits  representing  the  states 

,_2  along  with  the  input  bit  gives  a  state  with  K-1  bits  for  the  constraint 
[th  K  code.  Similarly,  at  time  t-2  we  must  know  the  best  metrics  of 
.  If  we  have  been  operating  with  a  constraint  length  K'  trellis,  we 
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[I 


have  been  keeping  track  of  only  the  best  metrics  of  [S]  ,  Therefore,  we 

must  start  expanding  the  trellis  K-K*  time  units  before  we  start  decoding  at 
constraint  length  K.  Clearly,  by  contracting  and  expanding  the  trellis  at  the 
appropriate  time,  no  information  regarding  the  survivors  or  metrics  will  be 
lost . 

Theorem  3 ;  Let  K'  <  K  and  suppose  the  degrees  of  the  generator  polynomials 
for  a  constraint  length  K*  convolutional  code  suddenly  increase  from  K'-l  to 
K-1  at  time  t.  Starting  to  expand  the  constraint  length  K'  trellis  (K-K*) 
input  bits  before  time  t  will  ensure  no  loss  of  informat.on  on  the  metrics  or 
survivors . 

We  should  note  that  there  will  be  some  delay  from  the  time  the  input  bits 
arrive  through  the  channel  to  the  time  the  input  bits  are  processed  by  the 
Viterbi  algorithm.  This  delay,  in  practical  applications,  will  be  much 
greater  than  the  (K-K')  bit  delay  required  by  Theorem  3.  If  necessary,  we  can 
institute  a  mandatory  delay  in  the  processing  of  the  input  bits  so  that  the 
bits  that  arrived  K-K'  bits  previous  to  the  change  in  the  channel  are  acces¬ 
sible.  Since  the  difference  K-K'  can  never  be  larger  than  the  largest  possi¬ 
ble  constraint  length  for  a  given  channel,  a  delay  of  M  bits  should  be  suffi¬ 
cient,  where  M  is  an  upper  bound  for  the  largest  possible  constraint  length. 

IV.  THE  TIME -VARIANT  HF  CHANNEL 


In  order  to  discuss  the  complexity  of  decoding  for  the  time-variant 
channel,  ws  must  first  set  up  a  model  for  the  hf  channel.  A  very  simple  model 
would  consist  of  a  shift  register  of  length  K  with  one  generator  polynomial 
K 

g(x)  =  2  ^  »  where  the  g.  terms  are  nonnegative  real  numbers  and  the 

i=1  ^ 

input  bits  are  {+1,  -1).  The  g^  terms  tap  the  input  bits  in  the  shift  reg¬ 
ister,  and  each  bit  is  multiplied  by  the  corresponding  g^  and  added  together 
as  in  the  diagreun  below  to  form  the  code  word  generated  by  the  channel. 
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where  S  =  , . . . ,  . 

The  received  signal  R  will  be  C  with  vrtiite  Gaussian  noise  added.  The  Vitarbi 
algorithm  and  state  trellis  diagram  can  be  employed  on  our  model  of  the  hf 
channel . 

The  findings  presented  in  the  previous  section  dealt  specifically  with 

convolutional  codes:  however,  all  of  the  results  can  be  generalized  to  include 

the  channel .  Equations  ( 1 ) ,  ( 2 ) ,  and  ( 3 )  hold  because  they  deal  only  with  the 

state  transition  diagram,  which  is  identical  for  the  two  channels.  Since  the 

code  ««ords  ax&  generated  similarly  by  the  two  channels,  proposition  1  clearly 

holds .  It  is  known  ( ref  1 )  that  for  the  hf  channel ,  at  any  given  time  t^ ,  the 

metric  at  state  S  can  be  calculated  from  the  metrics  of  the  states  mapping  to 

S  (the  metrics  of  the  predecessors  of  S)  plus  an  update  factor.  This  factor 

is  a  function  of  the  input  symbol,  the  states  mapping  to  S,  the  code  word 

generated  from  the  state  transition  diagram,  and  the  received  vector  R.  If  we 

decode  a  constraint  length  K'  code  on  a  shift  register  of  length  K,  and  K'-l  < 

m  <  K-1,  by  grouping  the  states  by  their  initial  m  symbols  (ie,  [S]  ),  any  two 
•  n 

states  in  the  same  group  will  have  the  same  metric  update  factor.  If  we  let 
f(I,C,R)  be  the  metric  update  factor  (which  corresponds  to  log  prob  (R|C)  for 
convolutional  codes)  then  the  balance  of  the  results  of  section  III  follow, 
with  f(I,C,R)  replacing  log  prob  (R|C). 

V.  CATASTROPHIC  CODES 

Inasmuch  as  we  have  no  control  over  the  intersymbol  interference  pattern 
of  the  channel,  it  is  possible  that  nature  will  provide  us  with  a  poor  code. 

In  fact,  we  will  give  a  class  of  codes  ^ich  is  catastrophic.  A  code  is,  in 
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general,  said  to  be  catastrophic  if  a  finite  number  of  channel  errors  (or 
noise)  can  cause  an  Infinite  number  of  decoded  bit  errors.  This  is  the  result 
of  two  input  sequences  differing  in  an  infinite  number  of  positions  that 
generate  the  same  output  sequence  of  code  words  except  for  a  finite  number  of 
initial  discrepancies.  We  first  examine  codes  in  which  the  nonzero  taps  are 
equal  in  number . 

For  example,  consider  the  channel  where  K  *  2  and  g^  >  g^.  The  tt(0  input 
sequences 


X  »  +1-1+1-1  ,,,  (6) 

and 

Y  =  -l+l-l+l  , . . 

will  produce  an  output  sequence  of  all  zeros  once  the  second  input  bit  of  each 
sequence  is  Inserted  into  the  shift  register. 

We  have  just  shown  that  the  K  *  2,  g^  =  g^  code  is  catastrophic.  We  will 
show  that  any  code  with  equally  spaced  nonzero  equal  taps  is  catastrophic, 

A  collection  of  m  input  sequences  will  be  called  a  catastrophic  m~ tuple 
if  the  individual  encoded  output  sequences  are  all  the  same  except  for  a 
finite  number  of  initial  discrepancies.  The  existence  of  these  sequences 
in'^uceS  a  catastrophic  code.  Given  two  input  sequences 

A  ~  a^a^,,«  and  B  ^  bb^,,,, 

12  12 

we  can  create  a  new  sequence  A*B  ^  1*2^2*  **  ’ 

Mote  that  the  operation  *  is  neither  coninutative  nor  associative.  To  inter* 
leave  the  bits  from  three  sequences  A,B,  and  C,  we  write  (A*B*C)^  ~ 
a^b^c^a^b^c^, , , ,  [Mote  that  this  is  not  (A*B)*C,]  The  generalization  to  n 
sequences  should  be  clear. 
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If  we  have  two  nonzero  tapo  the  following  sequences  are  a  catas¬ 

trophic  quadruple:  X*X,  X*y,  y*X  and  y*y,  %(here  X  and  y  are  alternating 
sequences  of  +1  frcn  equation  (6).  All  four  input  sequences  eventually  yield 
the  all  zero  output  sequence. 

For  constraint  length  K  and  two  nonzero  taps  g.  °  g~#  we  have  a  cata- 

K-1  ' 

strophic  2  -tuple  consisting  of  all  possible  ways  of  interleaving  K-1  X's 

and  y's  together.  In  fact,  if  1  <  i  £  K-2,  are  any  input  sequences,  then 

and 


form  a  catastrophic  pair 


Next  we  consider  the  code  vrtiich  taps  every  bit  equally,  ie,  g^  -  g^  “  ... 
-  g^^  >  0.  Let  P  be  the  sequence  of  all  plus  1's  and  M  the  sequence  of  all 
minus  I's.  Then  a  catastrophic  (K-l)-tuple  %K>uld  be  «  (M*P*P*. . 

*  {P*#1*P*. .  .*P)j^_^  /.../  *  (P*P*P*...P*M)jj_^,  all  eventually  producing 

the  same  output  sequence.  By  interchanging  P  and  M  above,  we  have  another 
catastrophic  (K-l)-tuple. 


Finally,  for  equally  spaced  nonzero  equal  taps,  we  set  g^  >  0  and  the 
remaining  taps  will  either  be  zero  or  equal  to  g^ .  We  can  describe  this  by 


^1 


g^  if  1  =  1  (mod  t) 
0  otherwise  . 


If  the  code  is  to  be  of  constraint  length  K,  then  K  =  1  (mod  t) .  We  state  the 
following  proposition,  the  proof  of  which  is  immediate. 

Proposition  3 :  Let  C  be  a  constraint  length  R  code  with  g,  ■  g_ • • •  *■  g  >  0 , 

R  th  ^  ™  ^ 

and  let  be  a  constraint  length  K  code  with  every  t  bit  tapped  starting 

with  g^,  tdiere  K  ■  (R-Dt-t-l.  Then  if  we  input  the  t  sequences  A^ 


, . . . , 


A^  into 


I 


to  generate  the  t  output  sequences  respectively,  and  if  we  input 

^A^*A2* • • into  C^,  we  get  the  output  sequence  ^0 . .*0^^^. 

We  have  shovm  the  input  sequences  *  {M*P*P* . .  .*P)  , .  •  • »  ■ 

(P*P* . .  .*M)  are  a  catastrophic  (R-l)-tuple  for  the  code  Cj^.  Therefore,  if 

we  Interleave  any  t  of  the  sequences  S.,...,  S  ,  together,  it  follows  direct- 

t 

ly  from  Proposition  3  that  they  will  form  a  catastrophic  (R-1)  -tuple  for 

We  give  one  final  look  at  catastrophic  codes  with  unequal  taps.  Consider 
the  code  in  tdiich  g^  =  g^  emd  g^  =  ^^1*  input  sequences  X  and  Y  are  a 

catastrophic  pair.  If  differential  encoding  is  used,  ho%«ever,  the  sequences  X 
and  y  become  the  same  sequence,  which  saves  this  code  from  being  catastrophic. 

Another  example  of  a  catastrophic  code  with  unequal  taps  is  provided  by 
g^  =  g^,  and  g2  =  9^  =  2g^.  The  sequences  (P*P*M*M)^,  and  (M*P*P*M)^  form  a 
catastrophic  4- tuple,  and  these  input  sequences  are  distinct,  even  if  differ¬ 
ential  encoding  is  employed. 


VI .  CONCLUSIONS 

For  multipath  channels  with  intersymbol  interference,  there  exists  a 
modified  Viterbi  algorithm  that  is  maximum  likelihood.  For  time-variant, 
fading  channels  where  the  constraint  length  may  expand  or  contract  due  to  the 
latest  arriving  multipath,  given  that  the  channel  is  known  at  all  times,  we 
have  shown  that  the  complexity  of  the  algorithm  depends  upon  the  constraint 
length  at  which  it  is  currently  decoding.  The  same  holds  true  if  the  channel 
encoder  were  Instead  a  standard  convolutional  code  with  the  Viterbi  decoding 
algorithm.  If  the  earliest  received  signal  fades  in  and  out,  it  is  conjec¬ 
tured  that  the  same  reduction  in  the  complexity  of  the  algorithm  can  be  shown 
by  identifying  states  by  their  last  m  bits  and  building  an  input  delay  before 
the  bits  are  inserted  into  the  shift  register. 

The  Intersymbol  Interference  due  to  the  hf  multipath  channel  may  encode 
in  a  fashion  that  causes  the  channel  to  become  catastrophic.  This  happens 
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tAien  the  echoes  occur  at  regular  Intervals  and  are  all  of  equal  strength  and 
in  sooM  cases,  where  the  taps  are  unequal  in  magnitude. 


An  interesting  topic  for  further  study  would  be  the  Investigation  of  the 
error  rate  produced  by  a  catastrophic  code.  When  the  code  goes  into  a  cata¬ 
strophic  burst  of  errors,  in  some  Instances  the  actual  bit  error  rate  is  very 
low.  For  the  case  in  which  g^  *  g^  ~  ~  g|^>  any  two  sequences  from  the 

2 

given  catastrophic  (K-D-tuple  will  produce  an  error  rate  of  during  that 
burst.  Although  the  performance  of  the  code  may  decrease  because  of  its 
catast'rophic  nature,  it  does  not  necessarily  mean  that  the  code  is  impracti¬ 
cal. 


Another  topic,  not  touched  upon  in  this  paper,  is  the  probability  that 
the  channel  will  give  a  catastrophic  code.  As  the  taps  must  be  exactly  in  a 
certain  ratio  and  the  path  spacing  must  be  exact  multiple  of  the  baud  rate  to 
produce  a  catastrophic  code,  the  percentage  of  time  that  we  are  decoding  a 
catastrophic  code  will  be  small.  Ihese  problems  should  be  explored  further. 
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